3D Closed Loop Boundary Detection and 6 DOF Pose Estimation
نویسندگان
چکیده
For vision guided robotic assembly, one of the fundamental enablers is the robust estimation of 6 degree-offreedom (DOF) pose of industrial parts or subassemblies. In this paper, we present a method to estimate 6 DOF pose of automotive sheet metal panels using 3D closed loop boundary (CLB) features from a stereo vision. The 3D CLBs extracted are used to identify the corresponding CAD model and estimate its 6 DOF pose with reference to the camera frame. The novelty of the proposed method lies in the fact that 3D CLBs are extracted efficiently by matching 2D CLBs from the stereo pair with its search space confined to the region of interest (ROI) and by reconstructing only the 3D data of the matched CLBs using the epipolar constraint. Our proposed method of the 6 DOF pose estimation using 3D CLBs has been demonstrated and applied to several decklid inner panels at GM Research Lab. Experimental results indicate that the proposed method offer computation efficiency less than one second and high performance under occlusion: over success rate 90% under 15% of occlusion.
منابع مشابه
Online 3D Reconstruction and 6-DoF Pose Estimation for RGB-D Sensors
In this paper, we propose an approach to Simultaneous Localization and Mapping (SLAM) for RGB-D sensors. Our system computes 6-DoF pose and sparse feature map of the environment. We propose a novel keyframe selection scheme based on the Fisher information, and new loop closing method that utilizes feature-to-landmark correspondences inspired by image-based localization. As a result, the system ...
متن کاملCAD Model-based 3D Object Pose Estimation using an Edge-Based Nonlinear Model Fitting Algorithm
This paper addresses the design of a model-based 3D object pose estimation algorithm, which is one of the major techniques to develop a robust robotic vision system using a monocular camera. The proposed system first extracts line features of a captured image by using edge detection and Hough transform techniques. Given a CAD model of the object-of-interest, the 6-DOF pose of the object can the...
متن کاملImage Based 6-DOF Camera Pose Estimation with Weighted RANSAC 3D
In this work an approach for image based 6-DOF pose estimation, with respect to a given 3D point cloud model, is presented. We use 3D annotated training views of the model from which we extract natural 2D features, which can be matched to the query image 2D features. In the next step typically the Perspective-N-Point Problem in combination with the popular RANSAC algorithm on the given 2D-3D po...
متن کاملQuadrotor control using dual camera visual feedback
In this paper, a vision-based stabilization and output tracking control method for a four-rotor helicopter has been proposed. A novel 2 camera method has been described for estimating the full 6 DOF pose of the helicopter. This two camera system is consisting of a pan-tilt ground camera and an onboard camera. The pose estimation algorithm is compared in simulation to other methods (such as four...
متن کاملDepth-Encoded Hough Voting for Joint Object Detection and Shape Recovery
Detecting objects, estimating their pose and recovering 3D shape information is a critical problem in many vision and robotics applications. This paper addresses the above needs by proposing a new method called DEHV Depth-Encoded Hough Voting detection scheme. Inspired by the Hough voting scheme introduced in [13], DEHV incorporates depth information into the process of learning distributions o...
متن کامل